No evidence for chunking in spatial memory of route experience.

Spatial memory is important for supporting the successful completion of everyday activities and is a particularly vulnerable domain in late life. Grouping items together in memory, or chunking, can improve spatial memory performance. In memory for desktop scale spaces and well-learned large-scale environments, error patterns suggest that information is chunked in memory. However, the chunking mechanisms involved in learning new large-scale, navigable environments are poorly understood. In five experiments, two of which included young and older adult samples, participants watched movies depicting routes through building-sized environments while attempting to remember the locations of cued objects. We tested memory for the cued objects with virtual pointing, distance estimation, and map drawing tasks after participants viewed each route. Patterns of error failed to show consistent evidence of chunking in spatial memory across all experiments. One possibility is that chunking in spatial memory relies on visual perceptual grouping mechanisms that are not in play during encoding of large-scale spaces encountered through extended route experiences that do not afford concurrent viewing of target locations. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Bayesian Surprise Predicts Human Event Segmentation in Story Listening.

Event segmentation theory posits that people segment continuous experience into discrete events and that event boundaries occur when there are large transient increases in prediction error. Here, we set out to test this theory in the context of story listening, by using a deep learning language model (GPT-2) to compute the predicted probability distribution of the next word, at each point in the story. For three stories, we used the probability distributions generated by GPT-2 to compute the time series of prediction error. We also asked participants to listen to these stories while marking event boundaries. We used regression models to relate the GPT-2 measures to the human segmentation data. We found that event boundaries are associated with transient increases in Bayesian surprise but not with a simpler measure of prediction error (surprisal) that tracks, for each word in the story, how strongly that word was predicted at the previous time point. These results support the hypothesis that prediction error serves as a control mechanism governing event segmentation and point to important differences between operational definitions of prediction error.

Impaired prediction of ongoing events in posttraumatic stress disorder.

The ability to make accurate predictions about what is going to happen in the near future is critical for comprehension of everyday activity. However, predictive processing may be disrupted in Posttraumatic Stress Disorder (PTSD). Hypervigilance may lead people with PTSD to make inaccurate predictions about the likelihood of future danger. This disruption in predictive processing may occur not only in response to threatening stimuli, but also during processing of neutral stimuli. Therefore, the current study investigated whether PTSD was associated with difficulty making predictions about near-future neutral activity. Sixty-three participants with PTSD and 63 trauma controls completed two tasks, one testing explicit prediction and the other testing implicit prediction. Higher PTSD severity was associated with greater difficulty with predictive processing on both of these tasks. These results suggest that effective treatments to improve functional outcomes for people with PTSD may work, in part, by improving predictive processing.

Adult age differences in event memory updating: The roles of prior-event retrieval and prediction.

Remembering past events can lead to predictions of what is to come and to experiencing prediction errors when things change. Previous research has shown enhanced memory updating for ongoing events that are inconsistent with predictions based on past experiences. According to the Event Memory Retrieval and Comparison (EMRC) Theory, such memory updating depends on the encoding of configural representations that bind retrieved features of the previous event, changed features, and the relationship between the two. We investigated potential age-related differences in these mechanisms by showing older and younger adults two movies of everyday activities. Activities in the second movie either repeated from the first movie or included changed endings. During the second movie, before activities ended, participants were instructed to predict the upcoming action based on the first movie. One week later, participants were instructed to recall activity endings from the second movie. For younger adults, having predicted endings consistent with the first movie before seeing changed endings was subsequently associated with better recall of these changed endings and recollection that activities had changed. Conversely, for older adults, making such predictions prior to changes was associated with intruding details from the first movie endings and was less strongly associated with change recollection. Consistent with EMRC, these findings suggest that retrieval of relevant experiences when events change can trigger prediction errors that prompt associative encoding of existing memories and current perceptions. These mechanisms were less efficient in older adults, which may account for their poorer event memory updating than younger adults. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Cueing natural event boundaries improves memory in people with post-traumatic stress disorder.

People with post-traumatic stress disorder (PTSD) often report difficulty remembering information in their everyday lives. Recent findings suggest that such difficulties may be due to PTSD-related deficits in parsing ongoing activity into discrete events, a process called event segmentation. Here, we investigated the causal relationship between event segmentation and memory by cueing event boundaries and evaluating its effect on subsequent memory in people with PTSD. People with PTSD (n = 38) and trauma-matched controls (n = 36) watched and remembered videos of everyday activities that were either unedited, contained visual and auditory cues at event boundaries, or contained visual and auditory cues at event middles. PTSD symptom severity varied substantial within both the group with a PTSD diagnosis and the control group. Memory performance did not differ significantly between groups, but people with high symptoms of PTSD remembered fewer details from the videos than those with lower symptoms of PTSD. Both those with PTSD and controls remembered more information from the videos in the event boundary cue condition than the middle cue or unedited conditions. This finding has important implications for translational work focusing on addressing everyday memory complaints in people with PTSD.

The multi-angle extended three-dimensional activities (META) stimulus set: A tool for studying event cognition.

To study complex human activity and how it is perceived and remembered, it is valuable to have large-scale, well-characterized stimuli that are representative of such activity. We present the Multi-angle Extended Three-dimensional Activities (META) stimulus set, a structured and highly instrumented set of extended event sequences performed in naturalistic settings. Performances were captured with two color cameras and a Kinect v2 camera with color and depth sensors, allowing the extraction of three-dimensional skeletal joint positions. We tracked the positions and identities of objects for all chapters using a mixture of manual coding and an automated tracking pipeline, and hand-annotated the timings of high-level actions. We also performed an online experiment to collect normative event boundaries for all chapters at a coarse and fine grain of segmentation, which allowed us to quantify event durations and agreement across participants. We share these materials publicly to advance new discoveries in the study of complex naturalistic activity.

Virtual navigation in healthy aging: Activation during learning and deactivation during retrieval predicts successful memory for spatial locations.

Spatial navigation and spatial memory are two important skills for independent living, and are known to be compromised with age. Here, we investigate the neural correlates of successful spatial memory in healthy older adults in order to learn more about the neural underpinnings of maintenance of navigation skill into old age. Healthy older adults watched a video shot by a person navigating a route and were asked to remember objects along the route and then attempted to remember object locations by virtually pointing to the location of hidden objects from several locations along the route. Brain activity during watching and pointing was recorded with functional MRI. Larger activations in temporal and frontal regions during watching, and larger deactivations in superior parietal cortex and intraparietal sulcus during pointing, were associated with smaller location errors. These findings suggest that larger evoked responses during learning of spatial information coupled with larger deactivation of canonical spatial memory regions at retrieval are important for effective spatial memory in late life.

Understanding Everyday Events: Predictive-Looking Errors Drive Memory Updating.

Memory-guided predictions can improve event comprehension by guiding attention and the eyes to the location where an actor is about to perform an action. But when events change, viewers may experience predictive-looking errors and need to update their memories. In two experiments (Ns = 38 and 98), we examined the consequences of mnemonic predictive-looking errors for comprehending and remembering event changes. University students watched movies of everyday activities with actions that were repeated exactly and actions that were repeated with changed features-for example, an actor reached for a paper towel on one occasion and a dish towel on the next. Memory guidance led to predictive-looking errors that were associated with better memory for subsequently changed event features. These results indicate that retrieving recent event features can guide predictions during unfolding events and that error signals derived from mismatches between mnemonic predictions and actual events contribute to new learning.

PTSD is associated with impaired event processing and memory for everyday events.

Current theories of posttraumatic stress disorder (PTSD) propose that memory abnormalities are central to the development and persistence of symptoms. While the most notable memory disturbances in PTSD involve memory for the trauma itself, individuals often have trouble remembering aspects of everyday life. Further, people with PTSD may have difficulty segmenting ongoing activity into discrete units, which is important for our perception and later memory of the activity. The current study investigated whether PTSD diagnosis and symptom severity predicted event segmentation and memory for everyday activities. To do so, 63 people with PTSD and 64 controls with a trauma history watched, segmented, and recalled videos of everyday activities. Viewers with higher PTSD symptom severity showed lower agreement on locations of event boundaries and recalled fewer fine-grained actions than did those with lower symptom severity. These results suggest that PTSD symptoms alter event segmentation, which may contribute to subsequent memory disturbances.

Narratives bridge the divide between distant events in episodic memory.

Many studies suggest that information about past experience, or episodic memory, is divided into discrete units called "events." Yet we can often remember experiences that span multiple events. Events that occur in close succession might simply be linked because of their proximity to one another, but we can also build links between events that occur farther apart in time. Intuitively, some kind of organizing principle should enable temporally distant events to become bridged in memory. We tested the hypothesis that episodic memory exhibits a narrative-level organization, enabling temporally distant events to be better remembered if they form a coherent narrative. Furthermore, we tested whether post-encoding memory consolidation is necessary to integrate temporally distant events. In three experiments, participants learned and subsequently recalled events from fictional stories, in which pairs of temporally distant events involving side characters ("sideplots") either formed one coherent narrative or two unrelated narratives. Across participants, we varied whether recall was assessed immediately after learning, or after a delay: 24 hours, 12 hours between morning and evening ("wake"), or 12 hours between evening and morning ("sleep"). Participants recalled more information about coherent than unrelated narrative events, in most delay conditions, including immediate recall and wake conditions, suggesting that post-encoding consolidation was not necessary to integrate temporally distant events into a larger narrative. Furthermore, post hoc modeling across experiments suggested that narrative coherence facilitated recall over and above any effects of sentence-level semantic similarity. This reliable memory benefit for coherent narrative events supports theoretical accounts which propose that narratives provide a high-level architecture for episodic memory.

Knowledge and the reliability of constructive memory.

Memory is constructive, but that does not mean it is unreliable. When people remember the events of their lives they depend on knowledge, some of which is in the form of scripts or schemata. Schematic information encodes typical patterns in events, and for this reason schemata often contribute veridical features to memory reconstruction. This process can be thought of in Bayesian terms, as incorporating prior probabilities based on recurring patterns in experience. It also can be thought of in terms of statistical regression, such that information from knowledge is combined with information from episodic traces to reconstruct a best estimate of what happened.

Priming of movie content is modulated by event boundaries.

Perceivers spontaneously segment ongoing activity into discrete events. This segmentation is important for the moment-by-moment understanding of events, but may also be critical for how events are encoded into episodic memory. In 3 experiments, we used priming to test the possibility that perceptual event boundaries organize memory for everyday activity into episodic units. Viewers watched movies of everyday activities, such as someone washing a car, and then performed a yes-no recognition task using pictures taken from the movies. Some target pictures were preceded by a prime picture taken from 5 s previously in the movie. This produced priming, reducing response times for the target picture. Priming was greater when the prime was part of the same perceptual event as the target than when it was part of a different event, suggesting that event structure organizes episodic memory. This effect persisted when the sequence of activity was scrambled during encoding, which suggests that it reflects, in part, knowledge about event types and not just the specifics of a given episode. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The Science of Visual Data Communication: What Works.

Effectively designed data visualizations allow viewers to use their powerful visual systems to understand patterns in data across science, education, health, and public policy. But ineffectively designed visualizations can cause confusion, misunderstanding, or even distrust-especially among viewers with low graphical literacy. We review research-backed guidelines for creating effective and intuitive visualizations oriented toward communicating data to students, coworkers, and the general public. We describe how the visual system can quickly extract broad statistics from a display, whereas poorly designed displays can lead to misperceptions and illusions. Extracting global statistics is fast, but comparing between subsets of values is slow. Effective graphics avoid taxing working memory, guide attention, and respect familiar conventions. Data visualizations can play a critical role in teaching and communication, provided that designers tailor those visualizations to their audience.

The hippocampus constructs narrative memories across distant events.

Life's events are scattered throughout time, yet we often recall different events in the context of an integrated narrative. Prior research suggests that the hippocampus, which supports memory for past events, can support the integration of overlapping associations or separate events in memory. However, the conditions that lead to hippocampus-dependent memory integration are unclear. We used functional brain imaging to test whether the opportunity to form a larger narrative (narrative coherence) drives hippocampal memory integration. During encoding of fictional stories, patterns of hippocampal activity, including activity at boundaries between events, were more similar between distant events that formed one coherent narrative, compared with overlapping events taken from unrelated narratives. One day later, the hippocampus preferentially supported detailed recall of coherent narrative events, through reinstatement of hippocampal activity patterns from encoding. These findings demonstrate a key function of the hippocampus: the integration of events into a narrative structure for memory.

The role of prior-event retrieval in encoding changed event features.

When people experience everyday activities, their comprehension can be shaped by expectations that derive from similar recent experiences, which can affect the encoding of a new experience into memory. When a new experience includes changes-such as a driving route being blocked by construction-this can lead to interference in subsequent memory. One potential mechanism of effective encoding of event changes is the retrieval of related features from previous events. Another such mechanism is the generation of a prediction error when a predicted feature is contradicted. In two experiments, we tested for effects of these two mechanisms on memory for changed features in movies of everyday activities. Participants viewed movies of an actor performing everyday activities across two fictitious days. Some event features changed across the days, and some features violated viewers' predictions. Retrieval of previous event features while viewing the second movie was associated with better subsequent memory, providing evidence for the retrieval mechanism. Contrary to our hypotheses, there was no support for the error mechanism: Prediction error was not associated with better memory when it was observed correlationally (Experiment 1) or directly manipulated (Experiment 2). These results support a key role for episodic retrieval in the encoding of new events. They also indicate boundary conditions on the role of prediction errors in driving new learning. Both findings have clear implications for theories of event memory.

Event Representations and Predictive Processing: The Role of the Midline Default Network Core.

The human brain is tightly coupled to the world through its sensory-motor systems-but it also spends a lot of its metabolism talking to itself. One important function of this intrinsic activity is the establishment and updating of event models-representations of the current situation that can predictively guide perception, learning, and action control. Here, we propose that event models largely depend on the default network (DN) midline core that includes the posterior cingulate and anterior medial prefrontal cortex. An increasing body of data indeed suggests that this subnetwork can facilitate stimuli processing during both naturalistic event comprehension and cognitive tasks in which mental representations of prior situations, trials, and task rules can predictively guide attention and performance. This midline core involvement in supporting predictions through event models can make sense of an otherwise complex and conflicting pattern of results regarding the possible cognitive functions subserved by the DN.

Aging and the encoding of changes in events: The role of neural activity pattern reinstatement.

When encountering unexpected event changes, memories of relevant past experiences must be updated to form new representations. Current models of memory updating propose that people must first generate memory-based predictions to detect and register that features of the environment have changed, then encode the new event features and integrate them with relevant memories of past experiences to form configural memory representations. Each of these steps may be impaired in older adults. Using functional MRI, we investigated these mechanisms in healthy young and older adults. In the scanner, participants first watched a movie depicting everyday activities in a day of an actor's life. They next watched a second nearly identical movie in which some scenes ended differently. Crucially, before watching the last part of each activity, the second movie stopped, and participants were asked to mentally replay how the activity previously ended. Three days later, participants were asked to recall the activities. Neural activity pattern reinstatement in medial temporal lobe (MTL) during the replay phase of the second movie was associated with detecting changes and with better memory for the original activity features. Reinstatements in posterior medial cortex (PMC) additionally predicted better memory for changed features. Compared to young adults, older adults showed a reduced ability to detect and remember changes and weaker associations between reinstatement and memory performance. These findings suggest that PMC and MTL contribute to change processing by reinstating previous event features, and that older adults are less able to use reinstatement to update memory for changed features.

Structured Event Memory: A neuro-symbolic model of event cognition.

Humans spontaneously organize a continuous experience into discrete events and use the learned structure of these events to generalize and organize memory. We introduce the Structured Event Memory (SEM) model of event cognition, which accounts for human abilities in event segmentation, memory, and generalization. SEM is derived from a probabilistic generative model of event dynamics defined over structured symbolic scenes. By embedding symbolic scene representations in a vector space and parametrizing the scene dynamics in this continuous space, SEM combines the advantages of structured and neural network approaches to high-level cognition. Using probabilistic reasoning over this generative model, SEM can infer event boundaries, learn event schemata, and use event knowledge to reconstruct past experience. We show that SEM can scale up to high-dimensional input spaces, producing human-like event segmentation for naturalistic video data, and accounts for a wide array of memory phenomena. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Event Perception and Memory.

Events make up much of our lived experience, and the perceptual mechanisms that represent events in experience have pervasive effects on action control, language use, and remembering. Event representations in both perception and memory have rich internal structure and connections one to another, and both are heavily informed by knowledge accumulated from previous experiences. Event perception and memory have been identified with specific computational and neural mechanisms, which show protracted development in childhood and are affected by language use, expertise, and brain disorders and injuries. Current theoretical approaches focus on the mechanisms by which events are segmented from ongoing experience, and emphasize the common coding of events for perception, action, and memory. Abetted by developments in eye-tracking, neuroimaging, and computer science, research on event perception and memory is moving from small-scale laboratory analogs to the complexity of events in the wild.

Event memory uniquely predicts memory for large-scale space.

When a person explores a new environment, they begin to construct a spatial representation of it. Doing so is important for navigating and remaining oriented. How does one's ability to learn a new environment relate to one's ability to remember experiences in that environment? Here, 208 adults experienced a first-person videotaped route, and then completed a spatial map construction task. They also took tests of general cognitive abilities (working memory, laboratory episodic memory, processing speed, general knowledge) and of memory for familiar, everyday activities (event memory). Regression analyses revealed that event memory (memory for everyday events and their temporal structure), laboratory episodic memory (memory for words and pictures) and gender were unique predictors of spatial memory. These results implicate the processing of temporal structure and organization as an important cognitive ability in large-scale spatial-memory-from-route experience. Accounting for the temporal structure of people's experience while learning the layout of novel spaces may improve interventions for addressing navigation problems.